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Software Testing 

Background of the Invention 

Field of the Invention 

The present invention relates to software testing, and more specifically to a 
method and apparatus for testing entities such as programs and classes used in 
object oriented environments. 

Related Art 

A program generally refers to a set of instructions which are written 
according to a convention specified by a corresponding programming language. 
Typical programming languages define structures such as program delimiters (e.g., 
program begin and end), control structures (e.g., if ... else structure), and loops 
(e.g., for, while, until structures) using which a developer can develop programs. 
The programs when executed on a data processing system provide a desired 
feature. 

Programs are often part of what are referred to as classes in object oriented 
environments (e.g., based on Java programming language). Classes generally 
contain data structures and associated programs as is well known in the relevant 
arts. For conciseness, the description below is provided substantially with 
reference to classes. However, several aspects of the present invention may be 
implemented outside of object oriented environments. 
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There has been recognized a need to test classes typically before being used 
in production environments. Testing generally refers to identifying any problems 
(defects) in the developed classes. Thus, usually a tester tests the developed 
objects using testing tools after a developer has developed the programs and/or 
classes of interest. To facilitate the identification of problems with developed 
classes, a testing tool may need to support several features. 

One desired feature of testing is to ensure that all lines of code are 
executed at least once so that there can be some level of confidence that a class 
operates in an intended manner. In one prior approach referred to as 'stub and 
driver' approach, a developer typically designs drivers (a piece of code) which can 
be used by a tester to invoke different programs on the class being tested with 
different arguments. The class being tested may invoke other programs on other 
classes which may not yet be available to the tester. The tester often writes some 
dummy code to simulate such missing classes that can then be used to test the class 
of interest. The dummy code is referred to as a stub. 

A tester may not be able to determine whether all lines of code of a 
program are executed using the stub and driver approach usually because of 
absence of mechanisms to determine whether each line has been executed. In 
addition, the overhead (usually on the developer) in maintaining the stubs and 
drivers may not be acceptable in several environments. Accordingly, what is 



JP920000411 



-2- 



needed is a method and apparatus which enables an easy determination of whether 
all the program lines of a class have been executed at least once during testing. 

Another desirable feature of testing is the ability to provide different 
argument values (parameters) to each program contained within a class, A tester 
may use such a feature, for example, to control the program flow or to test a 
program with different arguments. One type of argument of particular interest is 
the ability to pass an instance of a class since such a feature simplifies testing of 
scenarios when an instance of a class is to be provided as an argument to another 
class. 

Yet another desirable feature of testing is the ability to quickly execute 
pieces of code, not part of the classes being tested, in the middle of testing classes. 
Such a feature may be used, for example, to examine or store the state of different 
variables contained within an instance of a class. 

Summary of the Invention 

An aspect of the present invention enables a tester to ensure that all 
statements (program lines) of programs are executed at least once. Each program 
is divided into potentially multiple groups, with each group containing a sequence 
of statements such that a tester can be certain that all statements of a group are 
executed if one statement of the group is executed. The program can be a part of 
a class sought to be tested. 
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The executed groups are determined as a tester continues testing a class of 
interest. In one embodiment, an extra statement is inserted into each group 
automatically by a testing system such that the execution of the extra statement(s) 
can be readily detected. An identifier is also associated with each group and the 
extra statement may include a mechanism to indicate that the extra statement has 
been executed by using the identifier. Accordingly, the identifier can be examined 
to determine the specific group that has been executed. The unexecuted groups 
are indicated using a suitable interface such that the tester can cause the 
unexecuted groups also to be executed. 

Another aspect of the present invention provides a convenient user 
interface using which a tester can conveniently be shown the status of execution of 
different groups. Several groups are logically grouped into a block. A block is 
shown as being executed only if all the corresponding (contained) groups are also 
executed. In an embodiment, the blocks are determined according to the 
programming language structures employed in coding the programs. Typical 
language structures include program delimiters (i.e., program begin and end), 
control structures (e.g., if... else structures), and loop structures (e.g., for, while, 
until structures). Thus, all groups within a program structure are grouped as 
block. 

When language structures are present in other language structures, the 
corresponding blocks are defined with a parallel hierarchy. Thus, a block at a 
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higher level of hierarchy may contain several blocks of lower level hierarchy, and a 
block at the lowest level corresponds to a group. Using such a hierarchical 
definition, the status of execution of blocks is made to parallel the logical coding of 
the programs, and thus make it easier for a tester to quickly appreciate where 
unexecuted blocks are present and how they can be caused to be executed. 

One more aspect of the present invention enables a tester to provide 
desired values for arguments of programs. The values may be chosen to control 
the execution flow to ensure all groups are executed. In addition, it may be 
desirable to execute programs with different argument values. 

Yet another aspect of the present invention enables a tester to instantiate 
classes and pass the resulting instances as an argument value. The instance may be 
given a name and the name is used to specify the instance as an argument. 
According to one convention, any entered string is examined for a match with the 
already instantiated instance names, and an instance is deemed to be intended if the 
entered string matches the corresponding name. 

Another aspect of the present invention allows a tester to define small 
pieces of code, termed as macros, and execute the macros in the middle of testing. 
That is, between initiating the execution of programs, the macros may be selected 
and executed. The macros may be used, for example, to display the status of 
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various variables within an instance of a class. In general, macros provide a tester 
the ability to address specific scenarios which are unique in that instance. 

Further features and advantages of the invention, as well as the structure 
and operation of various embodiments of the invention, are described in detail 
below with reference to the accompanying drawings. In the drawings, like 
reference numbers generally indicate identical, functionally similar, and/or 
structurally similar elements. The drawing in which an element first appears is 
indicated by the leftmost digit(s) in the corresponding reference number. 

Brief Description of the Drawings 

The present invention will be described with reference to the accompanying 
drawings, wherein: 

Figure 1 is a block diagram illustrating an example system in which the 
present invention can be implemented; 

Figure 2 is a flow chart illustrating a method in accordance with the present 
invention using which a tester can ensure that all lines of programs in a class are 
executed at least once; 

Figure 3 is a block diagram of an embodiment of computer system 100 
illustrating an example architecture for implementing various aspects of the present 
invention; 

Figure 4A contains the program lines of an example program used to 
illustrate the manner in which the program may be divided into groups; 
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Figures 4B and 4C depict the additional program lines inserted into the 
program of Figure 4A illustrating the manner in which the execution of different 
blocks can be determined in an embodiment of the present invention; 

Figure 5 is a flow chart illustrating the manner in which the status of 
execution of different groups/blocks may be displayed in an embodiment of the 
present invention; 

Figure 6 is a snapshot of a screen illustrating the manner in which the status 
of the blocks/groups of the program contained in Figure 4A may be displayed; 

Figure 7A is a snapshot of a screen illustrating an example user interface 
for instantiating an object prior to testing; 

Figure 7B illustrates the manner in which a tester may select a constructor 
when instantiating a class; 

Figure 7C illustrates the manner in which a tester may specify the name and 
argument values while instantiating a class; 

Figure 8 is a snapshot of a screen illustrating the manner in which a tester 
may examine the program lines to determine the argument values to pass to cause 
unexecuted blocks to be executed; 

Figure 9A is a snap-shot on a display screen illustrating the manner in 
which a tester selects a specific instance of an object on which a program may be 
later executed; 

Figure 9B illustrates the manner in which a tester may select a specific 
program may be executed on the object instantiated in Figure 9A; 
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Figure 9C illustrates the manner in which a tester may provide a desired 
argument value when executing a program; 

Figure 9D is a snap-shot of screen displaying the result of execution of the 
program of Figure 9B; 

Figure 10 is a snap-shot of a screen displaying the manner in which a tester 
may view all the instances of classes presently available for passing as an argument 
value for a program to be executed; 

Figure 11A is snap-shot of a screen displaying the attributes of an instance 

of a class; 

Figure 1 IB is a snap-shot of a screen illustrating the manner in which a 
macro can be defined according an aspect of the present invention; and 

Figure 11C is a snap-shot of a screen illustrating the manner in which a 
pre-defined macro can be selected and executed. 

Detailed Description of the Preferred Embodiments 
1. Overview and Discussion of the Invention 

A testing program provided according to an aspect of the present invention 
divides each program in a class into multiple groups, with each group containing a 
sequence of program lines such that one can be certain that all the program lines of 
the group will be executed if one of the lines is executed, but for the occurrence of 
some abnormal condition. As a tester tests the programs in the classes, the testing 
program keeps track of the groups which have been executed. By ensuring at least 
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one statement in all groups is executed, the tester can ensure that all lines in the 
programs are executed at least once. 

Another aspect of the present invention provides a convenient user 
interface using which a tester can readily appreciate the not-yet-executed 
("unexecuted") groups, and cause the corresponding groups also to be executed. 
The groups are in turn grouped according to the language structures (e.g., loop 
structure, control structure). Thus, a block may correspond to each language 
structure. When a lower level language structure is contained in a higher level 
structure, blocks with similar relationship are defined. The blocks at the lowest 
level may correspond to groups themselves. 

According to another aspect of the present invention, the testing program 
enables a tester to manually provide various argument values of interest to 
programs of a class being tested. The argument values may be provided, for 
example, to control the execution flow within a program so as to ensure that all 
groups are executed at least once. The arguments can generally be of any type, 
including instances of classes. As a result, a tester may ensure that a desired group 
is executed by passing arguments which cause execution of the group. 

One more aspect of the present invention provides a simplified user 
interface using which a tester may quickly implement (e.g., write) a small piece of 
code and execute the code in between the programs. The code may be executed, 
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for example, to examine the status of various instances of objects. In general, 
macros provide a tester the ability to address specific scenarios which are unique in 
that instance. 

The invention is described below with reference to Java environment for 
illustration. In general, several aspects of the present invention can be 
implemented with any structured programming language (e.g., C++). It should be 
further understood that numerous specific details, relationships, and methods are 
set forth to provide a full understanding of the invention. One skilled in the 
relevant art, however, will readily recognize that the invention can be practiced 
without one or more of the specific details, or with other methods, etc. In other 
instances, well-known structures or operations are not shown in detail to avoid 
obscuring the invention. 

2. Example Environment 

Figure 1 is a block diagram of computer system 100 illustrating an example 
environment for implementing the present invention. Even though computer 
system 100 is described with specific components and architecture for illustration, 
it should be understood that the present invention may be implemented in several 
other types of embodiments. For example, the invention can be implemented on 
multiple cooperating networked computer systems. In addition, each component 
can be implemented as a combination of one or more of hardware, software and 
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firmware, even though many features of the present invention are described herein 
as being implemented in software. 

Computer system 100 may contain one or more processors such as central 
processing unit (CPU) 110, cache 115, random access memory (RAM) 120, 
secondary memory 130, graphics controller 160, display unit 170, network 
interface 180, and input interface 190. All the components except display unit 170 
may communicate with each other over communication path 150, which may 
contain several buses as is well known in the relevant arts. The components of 
Figure 1 are described below in further detail. 

CPU 110 may execute instructions stored in RAM 120 to provide several 
features of the present invention. CPU 110 may contain one or more individual 
processors. RAM 120 may receive instructions from secondary memory 130 using 
communication path 150. Data may be stored and retrieved from secondary 
memory 130 during the execution of the instructions. 

Graphics controller 160 generates display signals (e.g., in RGB format) to 
display unit 170 based on data/instructions received from CPU 110. Display unit 
170 contains a display screen to display the images defined by the display signals. 
Input interface 190 may correspond to a key-board and/or mouse, and generally 
enables a tester to provide inputs. Network interface 180 enables computer system 
100 to communicate with other systems using protocols such as TCP/IP. 
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Secondary memory 130 may contain units such as hard drive 135 and 
removable storage drive 137. Secondary storage 130 may store the software 
instructions and data, which enable computer system 100 to provide several 
features in accordance with the present invention. Some or all of the data and 
instructions may be provided on removable storage unit 140, and the data and 
instructions may be read and provided by removable storage drive 137 to CPU 
110. Floppy drive, magnetic tape drive, CD-ROM drive, DVD Drive, Flash 
memory, removable memory chip (PCMCIA Card, EPROM) are examples of such 
removable storage drive 137. 

Removable storage unit 140 may be implemented using medium and 
storage format compatible with removable storage drive 137 such that removable 
storage drive 137 can read the data and instructions. Thus, removable storage unit 
140 includes a computer usable storage medium having stored therein computer 
software and/or data. An embodiment of the present invention is implemented 
using software running (that is, executing) in computer system 100. In this 
document, the term "computer program product" is used to generally refer to 
removable storage unit 140 or hard disk installed in hard drive 135. These 
computer program products are means for providing software to computer system 
100. 
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The features of the present invention are described below first with 
reference to flow charts, then with a software architecture, and finally with 
reference to example user interfaces. 

3. Method to Ensure Coverage in Testing 

Figure 2 is a flow chart illustrating the details of a method in accordance 
with the present invention. The method begins in step 201, in which control 
immediately passes to step 210. In step 210, computer system 100 divides each 
program in a target class (i.e., class to be tested) into multiple groups covering the 
entire program. If one instruction of a group is executed it may be reasonably 
assumed that all instructions of the group are executed unless some abnormal 
condition occurs. 

In step 215, computer system 100 determines the executed groups as the 
tester continues executing programs for testing purpose. In an embodiment 
described below, computer system 100 embeds program lines in each group so that 
the embedded lines indicate that the group has been executed when the embedded 
lines are executed. While the lines in the embodiment may be executed along with 
the program lines in potentially the same thread (or process) different mechanisms 
may be used to provide the an indication of the execution of the embedded lines. 
Examples of such mechanisms include simple print statements and inter-process 
communication (such as sockets) well known in the relevant arts. 
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In step 220, computer system 100 indicates the unexecuted groups to the 
tester. Various approaches (e.g., simple display of a list of unexecuted groups) 
can be undertaken to indicate the unexecuted groups. In an embodiment described 
below, the program is shown divided into blocks organized hierarchically, with a 
block at a higher level logically containing potentially several lower level blocks. 
A block at a higher level is deemed to be executed only if the lower level blocks 
are executed. 

In step 225, computer system 100 enables the tester to control execution 
flow by providing desired values as arguments such that the unexecuted groups 
can be executed. An argument type of particular interest is an instance of an 
object since the data structures in instances can be extensive and complex. An 
example architecture implemented within computer system 100 which can 
implement the method of Figure 2 is described below with reference to Figure 3. 

4. Example Architecture 

Figure 3 is a block diagram of an embodiment of computer system 100 
illustrating an example architecture for implementing various aspects of the present 
invention. Computer system 100 is shown containing instrumentation module 310, 
compilation module 320, JAVAC-compiler 330, class loader module 340, 
coverage tracking module 350, testing module 360, macro handling module 365, 
test tool controller 370, and GUI and display module 380. The data (stored in 
non-volatile memories or volatile memories) are shown as ellipses and the files 
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generated or operated on are shown as rectangles with broken lines. Each 
component of Figure 3 is described below in further detail 

Database 355 generally contains a non-volatile memory (implemented, for 
example, using secondary storage 130) enabling the storing of data, and associated 
software enables the data to be stored and retrieved in a structured matter usually 
in the form of queries. 

Instrumentation module 310 inserts statements into each group such that 
the execution of the corresponding groups can be conveniently ascertained. A 
unique identifier may be associated with each group, and the association 
information is communicated to group information and coverage database 355. 
Instrumented java file 312 represents the output of instrumentation module 310. 
The operation of instrumentation module 310 is illustrated below with an example 
with reference to Figures 4A and 4B. 

Compilation module 320 compiles instrumented file 312 using 
JAVAC-compiler 330 (available from Sun Micro Systems) to generate class file 
324. Class file 324 contains Java byte codes well known in the relevant arts. Class 
loader module 340 loads the classes in class file into memory 346, which may be 
implemented in RAM 120. Memory 346 stores data representing various instances 
of the loaded classes. 
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Once the environment is setup as described above, the components of 
Figure 3 described below enable classes in class file 324 to be tested. The 
operation and implementation of these components will be further clarified with 
reference to the user interfaces described in the sections thereafter. 

GUI and display module 380 provides a user interface using which a tester 
may test different classes provided in class file 324. An example graphical user 
interface with respect to several features of the present invention is described 
below in further detail. Help files 385 represent various files which may be used to 
provide a tester with online help information. 

Test tool controller 370 interfaces with GUI and display module 380, and 
controls the operations of testing module 360, macro handling module 365, and 
reporting and error logging module 375. That is depending on the commands 
issued by a tester, the operation of different modules may be initiated with the 
appropriate parameters. 

Testing module 360 executes the programs specified by test tool controller 
370, The executed programs include the additional lines of code inserted by 
instrumentation module 310. In addition, test tool controller 370 enables a tester 
to execute small pieces of programs, termed as macros, by interfacing with macro 
handling module 365. 
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Coverage tracking module 350 updates the group information in group 
information and coverage database 355 reflecting that the corresponding groups 
have been executed. The code included in Appendix A may be used for at least a 
part of such purpose. In an embodiment, the stored information merely reflects 
whether each group has been executed at least once or not. 

Macro handling module 365 allows a tester to execute a macro stored in 
macro files 367. Macro files 367 may be implemented using secondary storage 
130. The macros may be defined by a tester using GUI and display module 380. 
Reporting and error logging module 375 interfaces with test tool controller 370 
and testing module 360, and logs the various errors in log files and test results 
database 376. 

The description is continued first with reference to instrumentation noted 
above, and then with reference to example user interfaces which provide various 
features of the present invention. 

5. Instrumentation 

Figure 4A contains lines of a program of a class presented in file 301, and 
Figures 4B and 4C contain the lines of the corresponding instrumented file 312. 
Figure 4 A contains the code of a program titled 'addString' . The program accepts 
a string as an argument. Figures 4B and 4C contains additional program lines 
inserted. Instrumentation module 310 may insert comments also as illustrated. 
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Thus, the program of Figure 4 A is separated into 6 groups numbered, Bl 1 
- B16 (group identifiers) as shown in Figures 4B and 4C. In the described 
embodiments, a group may contain physically non-contiguous lines of code so long 
as all the lines in the group would be executed if one of the lines would be 
executed. Thus, line 27 of Figure 4A may be viewed as being part of the group 
identified byBll. 

Instrumentation module 310 may insert program statements, with each 
statement containing class name and group identifier as parameters into program 
code as depicted, for example, in lines 3, 9, 14, 18 of Figure 4B. While only one 
program statement is shown inserted for each group, more than one statement also 
can be inserted as a designer wishes. The effect of the inserted program statement 
is to pass the group identifier in the statement to coverage tracking module 350 
when the statement is executed. An example implementation of the inserted 
program statement is contained in Appendix A. 

Accordingly, database 355 may be updated to keep track of the groups 
which have and have not been executed. It is further desirable that the information 
be presented in a easily understandable manner to the tester so that the tester can 
ensure that all groups are executed at least once. An example approach to 
providing a convenient user interface is described below. 
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6. Convenient Execution of All Blocks 

Figure 5 contains a flow chart illustrating a method using which computer 
system 100 may enable a tester to conveniently know the status of different groups 
and cause the unexecuted groups to be executed. The steps are described with 
reference to the components of Figure 3 for convenience. The method may be 
practiced in other environments as well. 

The method starts in step 501, in which control immediately passes to step 
510. In step 510, instrumentation module 310 may divide each program of a 
target class into multiple groups (similar to in step 210). 

fi! In step 520, instrumentation module 310 may divide each program into 

° blocks, with each block containing one or more groups. The blocks may have a 

!?I hierarchical relationship, with blocks at a higher level potentially containing one or 

x: more blocks at a lower level. Several levels of hierarchy may be present in a 

H program as illustrated below with reference to Figure 6. 

In step 530, instrumentation module 310 associates each block with the 
corresponding group(s). By associating the groups with the blocks, the tester may 
be conveniently presented execution status in terms of blocks in a hierarchical 
fashion. While steps 520 and 530 are described as distinct steps, typically both 
steps are performed in parallel while the program code is parsed and examined. 
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In step 540, GUI and display module 380 displays the blocks in a 
hierarchical fashion. The display may begin after the class is loaded. The status of 
execution of each block may be indicated. The execution of higher level blocks 
may be deemed to be complete only if all the corresponding lower level blocks are 
executed. 

In step 550, the execution of the programs may be monitored to determine 
the group(s) which are executed. The data in database 355 may be updated to 
reflect any newly executed groups. In turn, the executed blocks may also be 
determined. In step 570, the data in database 355 may be updated to reflect the 
execution of any unexecuted group(s). 

In step 580, GUI and display module 380 may update the hierarchical 
display of blocks reflecting the status of different executed and unexecuted blocks 
(by implication groups). In step 590, test tool controller 370 may determine 
whether the tester wishes to execute another program. Control is transferred to 
step 550 if another program is to be executed, or else control transfers to step 599 
where the execution ends. 

The hierarchical display noted in step 540 and 570, and the manner in 
which a tester may execute programs are described below with examples. 

7. Hierarchical Display 
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As noted above, the hierarchical display may begin after a class is loaded. 
Thus, a tester may use GUI and display module 380 to indicate that the class in 
class file 324 is to be loaded. In response, test tool controller 370 may interact 
with class loader module 340 to cause the indicated class to be loaded. Loading 
generally causes the Java byte code to be loaded into RAM 120. Once the class is 
loaded, the corresponding hierarchical display may be shown as illustrated with 
reference to Figure 6. 

Figure 6 is a snapshot of a screen (e.g., generated on display unit 170) 
illustrating the manner in which GUI and display module 380 may display the 
status of the blocks/groups of the program contained in Figure 4A. It should be 
appreciated that the blocks are organized according to the language structures 
employed in coding the programs. At the first level of the hierarchy are the 
program delimiters (specifying the begin and end of the programs). There are the 
blocks corresponding to the if structure (an example of a control structure). There 
are also shown blocks corresponding to the loop structure (e.g., for). 

The screen depicts 'method block -addString' (a block for the program) at 
the highest level of hierarchy in WizStringList (a class). It is noted that the term 
method is often used in lieu of program in Java environment, and thus the Figures 
are shown using the term 'method' instead of 'program'. 
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At the second level of hierarchy within the AddString block, an if block 
(corresponding to IF statement on lines 5 and 6 of Figure 4A) and an else block 
(corresponding to the ELSE statement in 18 are shown). At a third level of 
hierarchy within the if block, only a for block (corresponding to line 9 of Figure 
4A) is shown. At a fourth level of hierarchy, the for block is shown containing if 
block (starting at line 10 of Figure 4 A), pre-break block (if the I condition of line 
10 if true), else block (line 14). 

Each block in turn is associated with one or more groups. Each block at 
the lowest level is associated with only one group. Thus, groups with identifiers 
13 (line 14 of Figure 4B), 14 (line 18 of Figure 4B), 15 (line 23 of Figure 4C) are 
respectively associated with if block, pre-break block and else block within the for 
block of Figure 6. The higher level blocks may also be associated with a group. 
Thus, the for block may be associated with group identifier 13. 

A block at the lowest level is deemed to be executed when the 
corresponding group is executed. A higher level block is deemed to be executed 
only if any associated block is and all the corresponding lower level blocks are 
executed. For example, the 'for block' in AddString block would be deemed to be 
executed only if the four sub-blocks (if, pre-break, else, and post-break blocks) are 
executed and group with identifier 13 is also executed. 
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The status of execution of each block is indicated by a cross Ox 9 ) mark 
(not executed case) or a check (V 5 ) mark (executed). The tester may click on the 
*-* or 4 +'sign associated with each higher level block would toggle between 
showing and not showing the lower level blocks. Thus, once the execution of a 
higher level block is complete, the tester may not have motivation in examining the 
status of lower level blocks. As a result, the detail is conveniently hidden from the 
tester, making the user interface more convenient. 

Using the hierarchical display of above, an example user interface using 
which the tester may first instantiate a class and then test the class, is described 
below. 

8. Instantiating a Class 

The tester may need to first instantiate an instance of a class before starting 
testing. Figure 7A depicts an example user interface for instantiating a class. The 
tester selects the class to be instantiated and then causes a menu to be displayed by 
using a right click when the mouse is on the Class icon. The tester then selects the 
'create 5 option. 

Control may then be automatically be transferred to Figure 7B, in which 
the tester may select a constructor which instantiates the class. More than one 
constructor may be present, and the tester selects one of the constructors. The 
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operation and implementation of constructors may be implemented in a known 
way. Once the constructor is selected, the selected class is instantiated. 

The tester may be provided the option of specifying the name (instl) and 
the argument(s) of the instance as depicted in Figure 7C. Multiple instances may 
be instantiated for a class. In an embodiment, the instances across all classes being 
tested need to be unique. 

The hierarchical display for the class is depicted in Figure 6 once a class is 
loaded. The tester may then examine each program within an instantiated class 
and cause all the blocks to be executed. The tester may first determine the 
arguments which would cause an unexecuted block to be executed, and then 
execute the program with the determined arguments as described below in further 
detail. 

9. Determining Arguments Which Would Cause Unexecuted Block to be 
Executed 

The approach to be described is generally referred to as 'white box testing' 
as the tester needs to be aware of the program code to ensure execution of all the 
groups (program lines). GUI and display module 380 enables a tester to examine 
the code (program lines) of a block by selecting the block. The tester may then 
determine the arguments which would cause the unexecuted groups to be 
executed. 
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Figure 8 is a snap-shot of a screen illustrating an example manner in which 
GUI and display module 380 enables a tester to view the code corresponding to 
the blocks. Only the pre-instrumented code is displayed for the convenience of the 
tester. There is shown a situation in which the if block (of WizStringList) has not 
yet been executed, and the else block has been executed. 

The tester accordingly selects (shown with grey highlighting) the 
WizStringList block. The corresponding code is displayed in the display portion. 
The lines of code which are executed may be shown in one color and the 
unexecuted lines may be shown in another color (e.g., red). The tester may readily 
observe that the unexecuted else block may be executed by passing a number less 
than 1 as an argument to WizStringList program. The tester may then execute the 
program with the determined parameter(s) as described below. 

10. Executing a Program with Desired Arguments 

Figure 9A is a snap-shot on a display screen illustrating the manner in 
which a tester selects a specific instance of an object on which a program may be 
later executed. The tester may select invoke option on the 'instl' instance (the 
only instance), and control is automatically transferred to Figure 9B, in which all 
the programs are listed. 
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In Figure 9B, the tester selects the specific program to be executed and 
control is transferred to Figure 9C, in which the tester may provide a desired 
argument value. To cause the execution of the IF block of the example of Figure 
8, the tester may provide a number 0 to cause the unexecuted IF block to be 
executed. 

The value returned by the execution of the program may be immediately 
displayed as depicted in Figure 9D. The tester may indicate whether the execution 
should be considered a failure or as pass, and the corresponding result is logged in 
log files 376. 

11. Passing a Class Instance as a Parameter/Argument 

In general, the class which is to be passed as an argument, needs to be first 
instantiated and any necessary programs executed. The results are to be stored 
and provided as arguments to another program. It may be noted that the class 
provided as an argument need not be instrumented, and just the corresponding 
executable code (without source code) is sufficient. 

Thus, a tester may create an instance of a class, for example, as described 
above with reference to Figures 7A - 7C. All the instances of all classes may be 
displayed, for example, as shown in Figure 10. There are shown three instances 
str2 and strl of class String, and instl of class WizStringList The details of three 
instances and the manner in which the variables within the instances may have been 
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set, are not described as not being necessary for an understanding of the present 
invention. However, it should be appreciated that the instances may be operated 
upon just as any other class instances. 

It shall hypothetical^ be assumed that the tester wishes to pass strl 
instance as an argument to a program. In one embodiment, the tester merely 
enters 'strl' (instead of "This is a String") in response to a request for input as 
requested in Figure 9C. Testing module 360 compares entered value with all the 
stored instances (shown in Figure 10), and determines that the tester intended an 
instance as an input if the input matches (equals) the name of any instance. If the 
input type is determined to be an instance, the instance is passed as an argument. 

It should be appreciated that other conventions may be employed to 
conveniently determine whether a tester provided the name of an instance or a 
string/text input. For example, the tester may be expressly forced to specify the 
type of input expressly (instead of impliedly as in the example of the preceding 
paragraph). Thus, a tester may provide an instance of an object as an argument in 
accordance with an aspect of the present invention. 

Another requirement with typical testing systems is that the tester may 
need the ability to execute a small piece of code in the middle of testing class(es). 
The code may be used, for example, to examine different variables of complex 
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classes. The manner in which a tester may execute small pieces of code provided 
in the form of macros is described below. 

12. Macros 

For illustration, it will be assumed that instance instl (introduced above) 
has the attributes shown in Figure 11 A. The instance is shown containing a 
variable entitled 'list 5 of the type vector. It may be desirable to print the elements 
of the vector list. An aspect of the present invention enables a tester to write and 
execute a macro to achieve a desired purpose (such as printing or 'populating' the 
variables in instances of objects). 

The tester (or even a developer) may first need to specify a class to which 
the macro is to be directed. Thus, with reference to Figure 1 IB, the tester may 
select the Macro option (on the bar at the top) while WizStringList is highlighted. 
The tester can then enter the program lines for the macro. The program lines 
typically need to be provided according to a pre-specified convention. 

According to a convention employed in association with Figure 11B, a 
reserved variable 'handle 5 points to the instance on which the macro is later 
invoked. As may be appreciated, the code of the macro is shown written in Java 
programming language. The pointer may be maintained by macro handling module 
365. Thus, when the tester later selects the specific instance on which the macro is 
executed, the variable handle is caused to point to the selected variable. 
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A tester may then be provided a pop-up menu as shown in Figure 1 1C to 
select from all the available macros. When the macro is initiated, the values in the 
vector are printed. Similar approach can be used to populate (i.e., set values for 
variables) a class also, as will be apparent to one skilled in the relevant arts by 
reading the disclosure provided herein. Other typical scenario where macros can 
be used include, invoking other programs on a handle. Such other macros are also 
contemplated to be within the scope and spirit of the present invention. In general, 
the ability to define and execute macros provides a tester the ability to address the 
needs of unique situations presented during testing. 

13. Conclusion 

While various embodiments of the present invention have been described 
above, it should be understood that they have been presented by way of example 
only, and not limitation. Thus, the breadth and scope of the present invention 
should not be limited by any of the above-described exemplary embodiments, but 
should be defined only in accordance with the following claims and their 
equivalents. 
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A ppendix A 

/** 

The method to be invoked to signal the execution of a code block 

@param className The class name in which the block was executed. 
@param blockNumber The block number in the class that was executed. 

*/ 

public static void trackExecution(String className, int blockNumber) { 
/* Get the handle to the tree buffer */ 

WizTreeBuffer treeBuffer = WizInstrClass.getlnstanceO.getTreeBufferO; 

/* Locate the tree for the class passed, it will always be there */ 
int numRecords = treeBuffer.getNumRecords(); 

/* Look for the class */ 
int index; 

for(index=0;index<numRecords;index-H-) { 

if(treeBuffer.getSt^ { 
break; 

/* look for the block */ 

if(blockNumber = treeBuffer.getInt(index,WizInstrGlobalClass. BLOCK NUMBER)) { 
int status = treeBuf&r.getInt(mdex,WizIn^ 

/* increment and set the value */ 

treeBuffer.setta(mdex,WizIr^ 

} 

else { 

up(lateBtock(treeBuffer.getBufrer(^^ 

blockNumber); 
} 

/* Update the flags*/ 
if(updateFlags(treeBuffer)) { 

treeBuffo.setInt(mdex,WizIn^ 
XECUTED); 
} 

treeBuffer.setmt(mdex,WizInstrGlobalClassJLOCKS_EXECUTED,^ 

} 
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